Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove .log suffix from default event.dataset #63

Merged
merged 1 commit into from
Aug 30, 2021

Conversation

felixbarny
Copy link
Member

The .log suffix in event.dataset is considered bad practice, according to @ruflin.
Instead of my_service.log, my_service is preferred for the event.dataset.

@weltenwort do you agree with that?

See also the discussion in elastic/beats#27404 (comment)

Having .log in the dataset name is a bit unfortunate. That it is a log should be defined by the type already. Lets remove it.

@apmmachine
Copy link

apmmachine commented Aug 23, 2021

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2021-08-30T04:24:00.405+0000

  • Duration: 6 min 6 sec

  • Commit: a07e714

Trends 🧪

Image of Build Times

Copy link
Member

@ruflin ruflin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

I tried to figure out where this .log is coming from. There are some datasets where we used .log. This predates the data stream naming scheme and data_stream.* fields. If I remember correctly we did this to differentiate the logs from the metrics dataset. But with data_stream.type this differentiation is done by an additional field and it is now even in a different index so this is not needed anymore.

@felixbarny
Copy link
Member Author

felixbarny commented Aug 23, 2021

ECS loggers aim to be compatible with older ES versions so we should also think about legacy indices.

However, event.dataset and data_stream.dataset must have the same value. I think it's also not a big loss to not have the .log suffix in legacy indices.
ECS loggers don't support setting data_stream.dataset yet, but there's a draft PR open: #38. There's an outstanding Beats issue to make sure that Filebeat doesn't override data_stream.dataset if it's present in the logs.

@basepi
Copy link

basepi commented Aug 23, 2021

@weltenwort
Copy link
Member

From the Logs UI perspective there is no dependency on specific dataset suffixes, so this sounds fine by me.

@felixbarny felixbarny merged commit 760f1f4 into master Aug 30, 2021
@felixbarny felixbarny deleted the event.dataset-default branch August 30, 2021 14:16
felixbarny added a commit to elastic/apm that referenced this pull request Aug 30, 2021
felixbarny added a commit to elastic/apm that referenced this pull request Sep 10, 2021
trentm added a commit that referenced this pull request Oct 16, 2023
Back in #63 the guidance was changed to *not* have the .log
suffix on `event.dataset`.
trentm added a commit that referenced this pull request Oct 17, 2023
Back in #63 the guidance was changed to *not* have the .log
suffix on `event.dataset`.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants